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Ongoing Reproducibility Crisis 


Jeff Miller, Ph.D. 


By unspoken consent and, no doubt, many times uncon- 
sciously, modern American society blindly places its trust 
in the supposed findings of the naturalist-dominated 
scientific community. Given the ongoing reproducibility 
crisis in the scientific community, however, the logical 
person should seriously reevaluate where he places his 


faith. 


OW can the scientific 
community know a scien- 
tific study can be trusted? 


How can we know that a scientist 
did not fabricate, exaggerate, or 
bias his or her results in some way 
so that the study would achieve 
the desired conclusion? Reproduc- 
ibility—the ability of a different 
group of researchers to replicate the 
same study and arrive at the same 
results—is a key tool available to the 
scientific community. Ifa researcher 
fabricates or exaggerates results, or 
conducts bad science in some other 
way, for instance, then another lab 
attempting to conduct the same 
study will fail to achieve the same 
results as the first study. The scien- 
tific community can then see the 
“smoke” that often communicates a 
flawed study. “Replicability is the 
basis of all good science... “When 
you publish a paper, it is your ethi- 
cal duty to make sure other people 
can reproduce it,” says Regius pro- 


fessor of chemistry at the University 
of Glasgow, Lee Cronin.’ Writing in 
Science, Marcia McNutt explained, 
“Science advances on a foundation 
of trusted discoveries. Reproduc- 
ing an experiment is one important 
approach that scientists use to gain 
confidence in their conclusions.”* 
That truth makes the acknowledged 
but embarrassing predicament 
facing the scientific community over 
the past decade highly concerning. 
McNutt continued, “Recently, the 
scientific community was shaken by 
reports that a troubling proportion 
of peer-reviewed preclinical studies 
are not reproducible.”’ In fact, the 
problem is so widespread across the 
scientific community that it is being 


"Replicability : 
is the basis of all 
good sctence." 
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described as a “reproducibility/rep- 
lication crisis.”* In her article titled 
“The Unscientific Method,” Sonia 
Cooke, writing in New Scientist, 
warned, “One obvious concern is 
that [flawed papers] could under- 
mine public faith in science itself.”” 
It should come as no surprise, there- 
fore, that some scientists are express- 
ing a frustration that, in America, 
there is a “crisis of faith in science.”° 
Consider that many areas of science 
today are largely composed of natu- 
ralists, humanists, and atheists. Is 


that a bad thing? 
THE REPRODUCIBILITY CRISIS 


ONSIDER some selected 
( quotes from the last few 

years concerning the repro- 
ducibility crisis: 

e David Peterson, writing in Nature: 
“Alarm about a ‘replication crisis’ 
launched a wave of projects that 
aimed to quantitatively evaluate 
scientific reproducibility.”” 

e John Bohannon, writing in Sci- 
ence: “Concerns that false posi- 
tive results might be common in 
psychology, where studies often 
involve small numbers of sub- 
jects and statistically weak effects, 
boiled over in 2011. The scandal 
spurred psychologists to clean up 
their field—both by replicating 
key studies and by creating new 
models of scholarly publication 
and peer review to restore con- 
fidence in published research.... 
In a report published in Science 
in August [2015], 270 psycholo- 
gists orchestrated a repeat of 100 
studies published in three top 
journals. On the downside, only 
39% passed the test.”* [Note that 
the 39% pass rate, as low as it was, 
was the rate after changes in the 
psychology community had been 
made.| 

e Jocelyn Kaiser, writing in Science: 
“The Reproducibility Project: 
Cancer Biology...reported this 


week that when it attempted to 
repeat experiments drawn from 
23 high-impact papers published 
about 10 years ago, fewer than 
half yielded similar results. The 
findings pose ‘challenges for the 
credibility of preclinical cancer 
biology, says psychologist Brian 
Nosek, executive director of the 
Center for Open Science.” 
e Bruce Bower, writing in Science 
News: “Psychology got rocked 
last year [2015—JM] by a report 
that many of the field’s pub- 
lished results vanish in repeat 
experiments,” though the report 
“provides ‘initial, not defini- 
tive evidence, that psychology 
has a reproducibility problem.” 
Attempting to provide an expla- 
nation, Stanford University 
epidemiologist John Ioannidis 
acknowledged that “[r]esearchers’ 
assumptions and expectations 
can influence their take on any 
results, ‘no matter how clear and 
strong they are, he says.”"” 
Understand that irreproducibil- 
ity implies that the research being 
reported is possibly flawed in some 
way, which should lead to journals 
retracting the research articles if 
they catch the mistake. Daniele 
Fanelli, writing in Nature: “[U]p 
until ten years ago, retractions were 
extremely rare,” but today, “retrac- 
tions are nearing 600 per year.” 
Donald Kornfeld and Sandra 
Titus, writing in Nature, acknowl- 
edge that the irreproducibility prob- 
lem has, in actuality, long been a 
problem in science: “The history of 
science shows that irreproducibil- 
ity is not a product of our times.”'” 
Does the layman individual who 
places his faith in science realize 
that fact? But how widespread is the 
problem in the science world today? 
e McNutt explained, “It is unlikely 
that the issues with irreproduc- 
ibility are confined to preclinical 


studies (social science has been 
equally noted, for example).””’ 

e “Some will be tempted to conclude 
that psychology is a bad apple, 
says Charles Carver, a psychologist 
at the University of Miami.... He 
insists this is not the case. “This 
is a problem of science, medical 
science no less than behavioral sci- 
ence. Replication efforts in other 
fields are equally low, says John 
Ioannidis, a biologist at Stanford 
University..., who suspects the 
true proportion of psychology 
papers that are not false positive 
is ‘something like 25%...[which] 
seems to be in the same ballpark 
as what we see in many biomedi- 
cal disciplines.’”“* 

Cooke concurred: “In fact, the 

problem extends far beyond psy- 


chology—dubious results are 
alarmingly common in many 
fields of science. Worryingly, 
they seem to be especially shaky 
in areas that have a direct bear- 
ing on human well-being—the 
science underpinning everyday 
political, economic and health- 
care decisions.”’* “Evidence is 
mounting that medical research 
is particularly prone to irrepro- 
ducibility. In 2012, Glenn Begley, 
a biotech consultant, showed that 
just 11 percent of the preclini- 
cal cancer studies coming out of 
the academic pipeline that he 
sampled were replicable... “The 
truth is everyone knew that this 
was a problem,’ says Begley. “No 
one really knew the magnitude 
of the problem.’””® 


Ioannidis “claimed that sloppy 
methods could mean more than 
half of all published scientific 
results are flawed.” Especially 
in those fields where effective 
“checks and balances are absent, 
irreproducible results are rife.”"” 

Nature conducted a survey of 
1,576 researchers and found that 


“[m]ore than 70% of researchers 
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have tried and failed to repro- 
duce another scientist’s experi- 
ments, and more than half have 
failed to reproduce their own 


experiments.” 


"..sloppy methods . 
could mean more 
than half of all 
ublished scientific 


results are flawed." 
KN J 
These realizations may be star- 
tling, but when the extended con- 
sequences of these examples of bad 
science are considered, the implica- 
tions become even more concerning. 
Jeffrey Brainard, writing in Science, 
reported that over two dozen papers 
were retracted upon finding that 
one of the co-authors “was among 
the most prolific fraudsters known 
to science.” Brainard continues, 
But the retractions, which began 
in 2015, didn’t mean the papers 
were gone for good, or that their 
influence waned.... [MJany jour- 
nal articles that cited one or more 
of [the] retracted papers did not 
warn readers that they referenced 
tainted work. Worse...the flawed 
findings were cited in 88 articles, 
published from 2003 to 2020, 
that are systematic reviews and 
clinical guidelines—potentially 
influential publications that 
often help guide medical treat- 
ments.... Would the authors and 
editors of these papers take action 
if alerted to the retractions...? 
For the most part [the investiga- 
tors found—JM] the answer was 
no.... [So, e]ven after they are 
retracted—publishing’s death 
sentence—these papers live 
on thanks to citations. And 
that could have real-world con- 
sequences, the study suggests. It 
found 39 of the 88 citing papers 


had drawn conclusions that, if 


[the] retracted papers were left 
out of the analysis, were likely to 

be substantially weaker. Journals 

flagged just four of these weak- 
ened studies for citing retracted 

papers. The study’s findings are 
“unfortunately very consistent” 
with others going back to the 

1990s, says Ivan Oransky, co-edi- 
tor of Retraction Watch, which 

reports on retracted papers and 

tracks them ina public database.” 


WHY IS THERE A CRISIS? 


LEARLY, to their credit, at 
least some within the sci- 
entific community do not 
deny that there is a problem. That 
realization has led to much discus- 
sion about the causes of the crisis. 
Subsequently, many have been iden- 
tified. One such cause is the overre- 
liance on statistics and probability 
(c.g., the P value”) in the determi- 
nation of what constitutes reliable 
results.” 
The ASA [American Statistical 
Association] saw misunderstand- 
ing and misuse of statistical sig- 
nificance as a factor in the rise in 
concern about the credibility of 
many scientific claims (some- 
times called the “reproducibility 
crisis”).... What scientists want 
is a measure of the credibility 
of their conclusions, based on 
observed data. The P value nei- 
ther measures that nor is it part 
of a formula that provides it... 
[There is an] illusion that the 
P value alone measures the cred- 
ibility of a conclusion, which 
opens the door to the mistaken 
notion that the dividing line 
between scientifically justified 
and unjustified claims is set by 
whether the P value has crossed 
the “bright line” of significance... 
Bright-line thinking, coupled 
with attendant publication and 
promotion incentives, is a driver 
behind selective reporting: 
cherry-picking which analysis 
or experiments to report on the 
basis of their P values. This in 
turn corrupts science and fills 


the literature with claims likely 
to be overstated or false.” 
Cooke reported that, “Research 
published last year [2015—JM] 
by Megan Head of the Australian 
National University in Canberra 
and her colleagues showed that 
dodgy statistics are rife in the bio- 
logical sciences. They scrutinized 
results from a wide range of scientific 
disciplines for evidence for ‘p-hack- 
ing’—collecting or selecting data 
or statistical analyses until non-sig- 
nificant results becomes significant. 
They found it to be particularly 
common in biological sciences.”” 
Scientific American concurred with 
the ASA, acknowledging that, “The 
use of p values for nearly a century 
to determine statistical signifi- 
cance of experimental results has 
contributed to an illusion of cer- 
tainty and reproducibility crises 
in many scientific fields... [I]t may 
be time for both scientists and the 
public to embrace the discomfort 
of being unsure” about the validity 
of scientific results.” It would be 
unwise to hold our breath waiting 
for that to occur, because scientists 
enjoy being respected, treated as the 
ultimate authorities, and receiving 
the funding that comes with sup- 
posed success. 

Consider, for example, what 
Cooke highlighted about scientists 
and irreproducible research in New 
Scientist. 

Science is often thought of as a 
dispassionate search for the 
truth. But, of course, we are all 
only human. And most people 
want to climb the professional 
ladder. The main way to do that 
if youre a scientist is to get grants 
and publish lots of papers. The 
problem is that journals have a 
clear preference for research 
showing strong, positive rela- 
tionships—between a particular 
medical treatment and improved 
health, for example. This means 
researchers often try to find 
those sorts of results. A few 
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go as far as making things up. 
But a huge number tinker with 
their research in ways they think 
are harmless, but which can bias 
the outcome. This tinkering can 
take many forms.... You peek at 
the results and stop an experi- 
ment when it shows what you 
were expecting. You throw out 
data points that don’t fit your 
hypothesis—something could 
be wrong with those results, 
you reason. Or you run several 
types of statistical analysis and 
end up using the one that shows 
the strongest effect. “It can be 
very hard to even see that biases 
might be entering your reason- 
ing,” says psychologist Brian 
Nosek at the University of Vir- 
ginia in Charlottesville, who led 
the team trying to replicate 100 
psychology studies. Take the ten- 
ency to scrutinize results that 
don’t fit with your predictions 
more carefully than those that 
do. “There’s no nefarious motive,” 
says Roger Peng at Johns Hop- 
kins University in Baltimore, 
Maryland. It’s just natural to 
assume these results are likely 
to be “wrong.” You might think 
that journals, which get peers 
from the same scientific field to 
review papers, would pick up on 
such practices. But, say critics, 
the system isn’t up to the task 
[since reviewers do not generally 
dig into the nitty-gritty details 
of the research—JM].... All this 
helps explain why so many stud- 
ies don’t hold up when others try 
to replicate them.” 
Kevin Heng, writing in American 
Scientist, expressed concern about 
the resistance by many scientists 
to transparency, releasing all the 
information that would be needed 
to reproduce their results. “It is not 
unheard of to encounter published 
papers in astrophysics where insuffi- 
cient information is provided for the 
reproduction of simulated results... 
Scientific truth is monopolized by 
a few and dictated to the rest. Is 
it still science if the results are not 


readily reproducible?”** More con- 
cerningly, are researchers attempt- 
ing to hide the weaknesses of their 
studies by not making available all 
of the relevant information from 
their studies? 

Cooke agreed with Nosek’s 
acknowledgement of scientists’ 
biases, highlighting that “[a]n 
alarming amount of research is 
flawed because of unconscious 
biases.””’ These include, 

Wishful thinking—Uncon- 
sciously biasing methods to 
confirm your hypothesis. 
Sneaky stats—Using the sta- 
tistical analysis that best sup- 
ports your hypothesis. Burying 
evidence—Not sharing research 
data so that results can be scru- 
tinized. Rewriting history— 
Inventing a new hypothesis to 
explain unexpected results. Tidy- 
ing up—Ignoring inconvenient 
data points and analysis in the 
write-up. 
Bohannon agreed with the tendency 
for many scientists to be biased in 
their work. Responding to the study 
uncovering major irreproducibility 
issues in psychology papers in 2015, 
he explained, 
The results lend support to the 
idea that scientists and journal 
editors are biased—consciously 
or not—in what they publish... 
The bias could be due to sci- 
entists throwing out negative 
results, for example, or journal 
editors preferentially accepting 
papers with bigger effects. Some 
of the replications even found 
the opposite effect compared 
with the original paper. “This 
very well done study shows that 
psychology has nothing to be 
proud of when it comes to rep- 
lication,” says Charles Gallistel, 
president of the Association for 
Psychological Science. “Their 
data are sobering and present 

a clear challenge to the field,” 

says Lynne Cooper, a psycholo- 

gist at the University of Missouri, 
Columbia.” 


Famous paleoanthropologist of 
George Washington University 
Bernard Wood and Alexis Uluutku 
acknowledged that in evolutionary 
science, “Paleoanthropology is sub- 
ject to confirmation bias, whereby 
researchers may give undue weight 
to evidence that confirms their 
preexisting ideas.”*” “[E]xaggerated 
confidence” in results can lead to 
their inability “to be reproduced 
by others.”*' They warned that, 
while “[i]t is accepted practice 
in paleoanthropology to present 
detailed reconstructions of human 
evolutionary history that rarely 
acknowledge the extent to which 
they are incomplete and bound to 
change,” it “would be more help- 
ful, as well as more accurate, to 
acknowledge that the hominin fossil 
record is incomplete and that there 
are therefore limits to what can be 
said about it.... Overselling narra- 
tives based on incomplete data runs 
the risk of feeding mistrust between 
scientists and the public.” 

Another study highlighted an 
additional source of bias: reputa- 
tional bias. The peer-review pro- 
cess of the National Institutes of 


Health, for example, was found to 
tend to award grants based more 
on the “reputation of a scientist 
or their workplace,” rather than 
“the strength of their ideas.” In 
Nature’s survey of 1,576 researchers, 
the bulk of the scientists acknowl- 
edged that irreproducibility can 
often bea result of researchers’ selec- 
tive reporting, a pressure to publish, 
low statistical power/poor analysis, 
not replicating a result enough in 
the original lab, and insufficient 
oversight/mentoring,** and yet the 
scientists publish their research 
anyway. William Kaelin, profes- 
sor of medicine at the Dana-Farber 
Cancer Institute, writing in Nature, 
expressed his concern about the 
change in biomedical research over 
the last several years: “[T]he goal of 
a paper seems to have shifted from 
validating specific conclusions to 
making the broadest possible asser- 
tions. The danger is that papers are 
increasingly like grand mansions 
of straw, rather than sturdy houses 
of brick.”” Such an approach is 
bound to lead to mistakes. 

When a scientist needs a certain 
result, the temptation is strong for 
him to ensure that result occurs, 

(cont. on p. 56) 


Reason & Revelation is published monthly by Apologetics Press, Inc. Periodicals postage 
paid at Montgomery, AL. Postmaster: Send address changes to Reason & Revelation, 
230 Landmark Dr., Montgomery, AL 36117; ISSN:[1542-0922] USPS# 023415. 


Apologetics Press is a non-profit, tax-exempt work dedicated to the defense of New 
Testament Christianity. Copyright © 2023. All rights reserved. 


Editor: 
Dave Miller, M.A., M.Div., M.A.R., Ph.D.* 


(*Communication, Southern Illinois University) 
Associate Editor: 
Jeff Miller, M.S., Ph.D.” 


(*Biomechanical Engineering, Auburn University) 


Annual Subscription Rates: 


$14.00 Domestic 
$12.00 Domestic Bulk 

(5+ TO SAME ADDRESS) 
$14.00 Canada & Overseas 


(PLUS SHIPPING) 
General inquiries, changes of address, 
or international callers: 


Phone: (334) 272-8558 


Fax: (334) 270-2002 


Orders: 
Phone: (800) 234-8558 
Fax: (800) 234-2882 


On-line Web store/catalog, subscription 
order/renewal form, currentissues, archives, 
and other information (all orders processed 
on a secure server): 


WIRES 
E-mail: 


www.ApologeticsPress.org 
mail@ApologeticsPress.org 


Discovery—Scripture & Science for 
Kids is a sister publication for children. For 
more information, please contact our offices 
or visit the Discovery Web site at: 

URL: www.DiscoveryMagazine.org 


MAY 2023 R&R 43(5):53 


ji 


APOLOGETICS Pipi ss 


With beautiful, full-color pictures and interesting facts about God’s 
wonderfully designed Creation, your child will develop a greater 
love both for reading and for the grand Designer. 


LEARN TO READ: 

Crows, Does, and Hippos 

Most American children have learned to read using such books as “Dick and Jane.” But what better 
way to teach children how to read than by using biblical concepts? The “Learn to Read” series is 
designed to provide books for children (ages 3-6) for the purpose of assisting them in learning to read, 
while simultaneously introducing them to the Creator and His creation. 


-32 pages, paperback 


EARLY READER: 
God Made Horses 
God created horses on the sixth day of Creation. Of all the animals God created, the horse is one of 
the most majestic and fascinating. Whether we are gazing at wild stallions, watching a rodeo, or seeing : 
a police horse at work, we should remember to thank our Creator for giving us horses. 
-382 pages, paperback 


ADVANCED READER: 

Amazing Eyes Designed by God 

The human eye has long been a strong argument for the existence of the Chief Engineer— God. 
Humans, however, are not the only living things with amazing eyes that testify about the Creator. From 
shrimp to sharks, cats to chameleons, and goats to geckos, decisive evidence of the Designer can be 
seen (with our amazing eyes) all around us. 


-82 pages, paperback 


God Made"@ 


TO PURCHASE BOOKS, VISIT 
STORE.APOLOGETICSPRESS.ORG 
OR CALL 
(800) 234-8558 


es 
enter eee 


ae FOR MORE INFORMATION, VISIT OUR WEBSTORE AT 


— STORE.APOLOGiRIGSPRESS.ORG 
2 - 


rather than unbiasedly, dispassion- 
ately seeking the truth regardless of 
what it takes to find it and the result 
he finds. A 2011 psychology study 
was conducted with its objective 
to “show how easy it is to generate 
statistical evidence for pretty much 
anything, simply by picking and 
choosing methods and data in ways 
that researchers do every day”—a 
study which is clearly being proven 
true.** 

McNutt, explaining why mis- 
takes can occur in studies that cause 
it to be irreproducible, noted that, 

The system under investiga- 
tion may be more complex than 
previously thought, so that the 
experimenter is not actually con- 
trolling all independent variables. 
Authors may not have divulged 
all of the details of a complicated 
experiment, making it irrepro- 
ducible by another lab. It is also 
expected that through random 
chance, a certain number of stud- 
ies will produce false positives.... 
Although there is always the pos- 
sibility that an occasional study is 
fraudulent, the number of pre- 
clinical studies that cannot be 
reproduced is inconsistent with 
the idea that all irreproducibil- 
ity results from misconduct in 
research.” 
Although some scientists do not 
want to acknowledge that outright, 
intentional fraud is a significant 
contributor to the reproducibility 
crisis, one would be naive to ignore 
its effect. Kornfeld and Titus argue 
that “irreproducibility is the product 
of two factors: faulty research prac- 
tices and fraud,” or in the words of 


Charles Babbage in 1830, “hoaxing, 
forging, trimming and cooking.” 
“[A] review of 2,047 life-science 
papers retracted from 1973 to 
2012 found that around 43% were 
attributed to fraud or suspected 
fraud.” Surveys indicate that “2% 
of scientists and trainees admit 
that they have fabricated, falsified 
or modified data. And a 1996 study 
of more than 1,000 post-docs found 
that more than one-quarter would 
select or omit data to improve their 
chances of receiving grant funding,”” 
A recent study published in Scientific 
American found that “collaborative 
dishonesty” is a common occur- 
rence among researchers. When a 
group of researchers have the incen- 
tive of making more money if they 
lie in their reports, the study found 


that, “Across all studies and tasks... 


groups tended to lie.... We also 
showed that collaborative dishon- 
esty is contagious and escalates... 
The brazen liar’s behavior influ- 
enced their partner. People were 
more likely to lie when their part- 
ner did. This dishonesty also grew 
over time.”*° To illustrate how deep 
the problem of fraud is, consider the 
alarming report made by Nature in 
2014, titled “Gibberish Papers”: 
The publisher Springer will 
remove 16 computer-generated 
nonsense papers that it had 
published in its subscription 
database, it said last week. The 
papers [were] created by a com- 
puter program called SClgen.... 
[T]he US Institute of Electrical 
and Electronic Engineers...has 
already withdrawn more than 
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100 nonsense articles. The 
papers had been included in 
conference proceedings, some of 
which were supposed to be peer- 
reviewed.*! 
Not only did scientists use a com- 
puter program to write a paper on 
a made-up study, but they were able 
to get the paper published, after 
it had been peer-reviewed! Even 
high-profile individuals in the sci- 
entific community—the ones who 
are supposed to be setting the tone 
for and leading other scientists in 
proper scientific research proto- 
cols—are not immune to being 
charged with fraudulent scientific 
research. “Allegations of scientific 
image manipulation are threaten- 
ing Stanford University President 
Marc Tessier-Lavigne, a neurobi- 
ologist and former biotech leader. 
Tessier-Lavigne came under fire last 
week [2022—JM] after an investiga- 
tion by the school’s student newspa- 
per revived long-standing concerns 
about several publications on which 
he was a co-author.” 


IS THE PROBLEM LIKELY TO BE FIXED? 


BVIOUSLY, in those many 
cases where a scientist pub- 
lishes research intentionally 


that is fraudulent, the reproducibil- 
ity problem will not improve unless 
a couple things happen. First, soci- 
ety should begin to more broadly 
and forcefully teach morality and 
ethics, as it once did. This, however, 
cannot ultimately fix the problem, 
unless society also acknowledges the 
Giver of moral law, Who provides 
humanity with the ultimate motiva- 
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tion for adhering to His law. With- 
out the incentive of eternal life in 
a real, glorious heaven and the fear 
of eternal damnation and Hell-fire 
in one’s mind, his commitment to 
adhering to an ethical standard is 
severely weakened. In the words of 
Charles Darwin in his autobiogra- 
phy, “A man who has no assured and 
ever present belief in the existence of 
a personal God or of a future exis- 
tence with retribution and reward, 
can have for his rule of life, as far 
as I can see, only to follow those 
impulses and instincts which are 
the strongest or which seem to him 
the best ones.”*? A God-less scien- 
tist who is highly motivated by fame, 
fortune, friends, or power instead 
of the truth that will set him free is 
perfectly poised to conduct dishon- 
est science when it suits him. Sadly, 
the bulk of the scientific commu- 
nity today is openly and brazenly 
God-less, even going so far as to 
define science in such a way that 
only natural explanations will be 
considered for anything that has 
ever happened in the Universe. If 
God has been defined out of science, 
should it surprise us that the scien- 
tific community is becoming ever 
more ungodly in its practices? 

A second “self-help” that the sci- 
entific community could implement 
to re-ignite a commitment to legiti- 
mate science and begin restoring 
faith in the scientific community 
would be to better expose and pub- 
licly punish the perpetrators of fraud 
in such a way that others will think 
twice before following in their foot- 
steps. But even in those cases where 
researchers made unintentional, 
unconscious mistakes in a study 
that was published, the bad science 
problem is not likely to improve 
any time soon, because the only 
remaining impetuses that should 
drive researchers to be humble and 
cautious in their reported findings 
is gradually being erased. 


In the Nature survey discussed 
above, the surveyors found from 
the polled scientists that, for one, 
“incentives to publish positive repli- 
cations are low.” Many researchers, 
therefore, see no reason to attempt 
to prove the legitimacy of a previ- 
ous study by replicating it. The 
result is that many studies are being 
assumed to be accurate without rep- 
licated support for that conclusion. 
A researcher, therefore, is less con- 
cerned about reporting incorrect 
results in the first place, since it is 
unlikely that his research will be dis- 
proved by negative replications later. 
Second, the surveyed scientists 
agreed that, when replications of a 
study are attempted by a separate 
lab, “journals can be reluctant to 
publish negative findings [i.e., find- 
ings that contradict the claims of 
the original study—JM]. In fact, sev- 
eral respondents who had published 
a failed replication said that editors 
and reviewers demanded that they 
play down comparisons with the 
original study.”** Fanelli reported 
that today there is an 
unprecedented opportunity to 
purge the scientific record of 
false claims. But retracting those 
published claims remains a rare 
and painful process. There are 
powerful incentives not to do 
so, for all involved, from univer- 
sities and scientists to publish- 
ers. Retractions still unwittingly 
punish all who take part.... The 
recalcitrance of scientists asked 
to retract work is not surprising. 
Even when they are honest and 
proactive, they have much to lose: 
a paper, their time and perhaps 
their reputation. 
Retractions, therefore, are rarer than 
they should be—which inevitably 
means that science being reported is 
not always as reliable as we are led to 
believe. Though retractions cannot 
completely fix the reproducibility 
crisis, (1) the shame of a retraction 
often acts as a deterrent to bad sci- 
ence, and (2) honest retractions 
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would at least help the scientific 
community to save a little face in 
some cases (and help rebuild soci- 
etal trust in science), since a retrac- 
tion looks like an honest (though 
possibly inept) mistake, rather than 
an intentional cover-up or fraud. 
Although neither interpretation 
should inspire much confidence in a 
scientist, the latter is certainly more 
grave and would immediately call 
into question all of the scientist’s 
previous research. 

Retractions might also, in some 
cases, stop the world from banking 
its decisions on faulty evidence. So, 
many scientists are, to their credit, 
frantic to encourage the retraction 
process. Amazingly, however, some 
have proposed counter-intuitive 
solutions that are certain to exacer- 
bate the problem. Martin Enserink, 
writing in Science, explained that, 
“Retractions are strongly associated 
with research misconduct. ‘I became 
worried about public shaming,” 
said Richard Mann, mathemati- 
cian at the University of Leeds in 
the United Kingdom. So, what’s 
the solution? To solve the problem, 
some in the scientific community 
are advocating that journals stop 
using the “r” word, since it might 
be too scary for some scientists. 
Enserink explains that some have 
proposed a way “to make it easier 
to retract a paper—by not calling 
it a retraction.””” Let’s consider the 
logic of their solution: 


1. Retractions shame the researcher 
and, therefore, provide a strong 
deterrent to bad or dishonest sci- 
ence. 

2. Many scientists are conducting bad 
science and publishing it dishon- 
estly, but will not openly admit 
their bad science because of the 
shame of a retraction. 


> Solution: eliminate shame so 
researchers will retract more 
bad science. 
We will grant that such a solu- 
tion might seem almost logical 


on the surface. It is likely, anyway, 
to encourage some to admit their 
mistakes and retract their findings. 
However, should not the goal be to 
encourage good science, not merely 
to increase retractions? We fail to 
see how eliminating the shame that 
accompanies a retraction would not 
open the flood gates for bad science, 
rather than encouraging good sci- 
ence. Though common today, it is 
an erroneous mindset that seeks 
to eliminate the consequences of 
bad actions rather than actually 
solving the problem by addressing 
the bad actions themselves. If a 
person is deserving of “public sham- 
ing,” should he not be courageous 
and responsible enough to own the 
consequences of his mistakes, and 
allow his correction to improve his 
future scientific pursuits?** That is 
the kind of “tough love” the scien- 
tific community needs in order to 
improve itself and regain trust. 

Sadly, since the bulk of the sci- 
entific community is naturalistic in 
its mindset, it has eliminated the 
primary driving Force for individual 
moral improvement. Unsurprisingly 
to the Christian, the scientific com- 
munity is now beginning to feel the 
consequences of its stubborn rebel- 
lion against God. The God-less 
scientific community around us 
is feeling the continuing tremors 
preceding the inevitable implosion 
of its plummeting reputation and 
trustworthiness. 

Kaelin, frustrated with the way 
science is being conducted by many 
researchers today, attempted to pro- 
vide counsel to scientists, though his 
comments are a concerning portrait 
about modern science. 

Papers need to include fewer 
claims and more proof to make 
the scientific literature more 
reliable.... | worry about slop- 
piness in biomedical research: 
too many published results are 
true only under narrow condi- 
tions, or cannot be reproduced 


le > 


"The main question 
when reviewin 
a paper should 
e whether its 
conclusions are 
likely to be correct, 
not whether tt 
would be important 


if it were true." 
\ SJ 


at all. The causes are diverse, but 
what I see as the biggest culprit 
is hardly discussed.... I fear the 
literature has devolved from 
papers making a single major 
claim that is proved in multiple 
ways to papers having multiple 
claims, each with a single reed 
of support. The final figures of 
papers today often seem a bridge 
too far. Overly broad claims push 
the peer-review system past its 
limit.... The main question 
when reviewing a paper should 
be whether its conclusions are 
likely to be correct, not whether 


it would be important if it were 
true. Real advances are built 
with bricks, not straw.’ 


Sadly, the likelihood of a widespread 


“repentance” movement among sci- 


entists is unlikely. On the positive 
side, however, some scientists recog- 
nize the authority of Scripture and 
seek, first-and-foremost, to please 
and glorify God as they conduct 
science. Though fallible men and 
women, since their foundation and 
perspective is correct, the science 
they conduct is far more likely to 
produce reliable results, since they 
are starting their study from the 
right place and have on the right 
lenses, which will allow them to 
view the world around them cor- 
rectly as they study it. 


IN SCIENCE SHOULD WE TRUST? 


ECALL that in the 2016 
Ri: study referenced ear- 
ier, 1,576 scientific research- 
ers were surveyed. The high number 
of surveyed researchers provides a 
reasonable glimpse at the mentality 
of the scientific community today. 
Although 52% of those surveyed 
agree that there is a significant 
“crisis” of reproducibility, less 
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than 31% think that failure 
to reproduce published results 
means that the result is prob- 
ably wrong, and most say that 
they still trust the published 
literature. Data on how much of 
the scientific literature is repro- 
ducible are...generally bleak. 
The best-known analysis, from 
psychology and cancer biology, 
found rates of around 40% and 
10%, respectively. Our survey 
respondents were more opti- 
mistic: 73% said that they think 
that at least half of the papers 
in their field can be trusted... 
When work does not reproduce, 
researchers often assume there 
is a perfectly valid (and probably 
boring) reason.”° 
The actual statistics indicate that 
reproducibility does not occur in 
well over 50% of studies, and yet 
the scientific community continues 
overwhelmingly to blindly believe 
in the validity of the studies, assum- 
ing without evidence that there are 
good reasons for the failure of repro- 
ducibility studies. 

Should society have a “blind 
faith” in science and its naturalis- 
tic “prophets,” as though they are 
unbiased, dispassionate, almost 
flawless truth seekers who are nearer 
to infallibility than the rest of the 
world? The evidence presented 
in this article ought to remind us 
always to maintain a healthy skepti- 
cism about the claims being made by 
the modern scientific community— 
especially in those studies where a 
conclusion is drawn that runs coun- 
ter to the teachings of the infallible 
Word of God. Where should our 
trust be placed? 
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We are delighted to announce the release of 
three more AP Readers to the collection. The 
“Learn to Read” series is designed to provide books 
for children (ages 3-6) for the purpose of assist- 
ing them in learning to read, while simultane- 
ously introducing them to the Creator and His 
creation. The new addition to this reader level is 
Crows, Does, and Hippos. 

The Early Reader series is written on a kin- 
dergarten through second grade level (ages 6-8). 
The new addition to this series is titled God Made 
Horses. 

Written for ages 7-9, our Advanced Reader 
series is designed to help children improve their 
developing reading skills while learning about 
God’s amazing design in nature. The addition to 
this fascinating series is titled Amazing Eyes. 

All three of the AP Readers series are designed 
to enhance youth reading skill while simultane- 
ously directing the child’s attention to God. With 
beautiful, full-color pictures and interesting facts 
about God’s wonderfully designed Creation, your 
child will develop a greater love both for reading 
and for the grand Designer. 
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